Frisch–Waugh–Lovell theorem

In econometrics, the Frisch–Waugh–Lovell (FWL) theorem is named after the econometricians Ragnar Frisch, Frederick V. Waugh, and Michael C. Lovell.

The Frisch–Waugh–Lovell theorem states that if the regression we are concerned with is:

$Y = X_1 \beta_1 %2B X_2 \beta_2 %2B u \!$

where $X_1$ and $X_2$ are $n \times k_1$ and $n \times k_2$ respectively and where $\beta_1$ and $\beta_2$ are conformable, then the estimate of $\beta_2$ will be the same as the estimate of it from a modified regression of the form:

$M_{X_1} Y = M_{X_1} X_2 \beta_2 %2B M_{X_1} u \!,$

where $M_{X_1}$ projects onto the orthogonal complement of the image of the projection matrix $X_1(X_1'X_1)^{-1}X_1'$ . Equivalently, M_X₁ projects onto the orthogonal complement of the column space of X₁. Specifically,

$M_{X_1} = I - X_1(X_1'X_1)^{-1}X_1'. \!$

This result implies that all these secondary regressions are unnecessary: using projection matrices to make the variables orthogonal to each other will lead to the same results as running the regression with all non-orthogonal included.

References

Ragnar Frisch; Frederick V. Waugh "Partial Time Regressions as Compared with Individual Trends" Econometrica, 1 (4) (Oct., 1933), pp. 387–401.
Lovell, M., 1963, Seasonal adjustment of economic time series, Journal of the American Statistical Association, 58, pp. 993–1010.
Lovell, M., 2008, A Simple Proof of the FWL (Frisch,Waugh,Lovell) Theorem, Journal of Economic Education.